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PACS 05 . 40 . -a - Fluctuation phenomena statistical physics. 
PACS 05 . 70 . Ln - Irreversible thermodynamics. 
PACS 87 . 16 . Nn - Motor proteins. 

Abstract. - We present a theoretical framework to understand a modified fluctuation-dissipation 
theorem valid for systems close to non-equilibrium steady-states and obeying markovian dynamics. 
We discuss the interpretation of this result in terms of trajectory entropy excess. The framework 
is illustrated on a simple pedagogical example of a molecular motor. We also derive in this context 
generalized Green-Kubo relations similar to the ones obtained recently in U. Seifert, Phys. Rev. 
Lett., 104, 138101 (2010) for more general networks of biomolecular states. 
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Introduction. — The application of linear response 
theory to systems in thermodynamic equilibrium leads 
4,0 the fluctuation-dissipation theorem (FDT) [I], which 
states that the response of an equilibrium system to small 
external perturbations is determined by correlations at 
equilibrium. Suppose that a system at thermal equilib- 
rium and governed by the time-independent Hamiltonian 
Hq is subject to a time-dependent perturbation — X(t)0 
from time t' on. Then the mean-value of a dynamic ob- 
servable A(t) at time t > t' over all path trajectories, 
(A(t)} pat h, satisfies at first order in A: 



R eq {t, t ) 



S(A(t)) path 
6X(t') 



P—(0(t>)A(t)) eq , (1) 



where the correlation function in the r.h.s. is evaluated 
at equilibrium j3 = 1/ksT being the inverse temperature. 
This relation is a fundamental tool in statistical mechan- 
ics since it allows to extract linear response transport co- 
efficients from an equilibrium situation [2,3 . Beyond the 
equilibrium regime, the relation between response and cor- 
relations does not take a simple and universal form as 
shown by formal studies of such relations for stochastic 
processes [3] or for glassy systems [5] . Experimentally, de- 
partures away from FDT in non-equilibrium systems have 
been observed in a variety of systems such as granular 
matter, sheared fluids and biological systems [5]. 



In the last decade, new directions of study on non- 
equilibrium systems have emerged. For instance, it has 
been realized that thermodynamic quantities like work 
[3[8] or entropy [9] acquire a well defined meaning at the 
level of a single trajectory. Various exact relations among 
the statistical distributions of work or heat, called fluc- 
tuation relations, have been derived. They typically hold 
very generally for a large class of systems and arbitrarily 
far from equilibrium [71 H0UI3] . The entropy production 
has been related in markovian systems to the difference 
between the forward and backward dynamical random- 
ness [33] or as the relative entropy of the trajectory mea- 
sures of the forward and backward dynamics [121115] . For 
hamiltonian dynamics, similarly, the entropy production 
has been understood in terms of the relative entropy be- 
tween forward and backward probability distributions in 
phase space [IB]. A classification of the various possible 
decompositions of the entropy production and of the cor- 
responding fluctuation relations has been proposed [T7] . 
Within the linear response regime and for slightly per- 
turbed non-equilibrium steady states (Ness), the fluctu- 
ation relations lead to a modified fluctuation-dissipation 
theorem (MFDT) [T51I18II19] . which has been tested exper- 
imentally using colloidal particles in optical traps [^HHH] . 
A thermodynamic interpretation of MFDT using the con- 
cept of entropy flow has been proposed in [22]. Besides, be- 
yond the linear regime, the same fluctuation relations can 
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be used to derive non-linear response relations of higher 
order [25] . 

Let us consider a system initially in a non-equilibrium 
steady state, characterized by a (set of) control param- 
eters denoted by A. For a given value of A, we assume 
that there exists a steady state with stationary probability 
distribution P st (c, A) = cxp(— </>(c, A)). A time-dependent 
perturbation of the dynamics at time t' around the fixed 
value Ao will be described by X(t') = A + 5X(t'). The re- 
sponse R(t,t') = 8(A(c(t), Ao)) pa th/<5A(t') of the dynamic 
observable A that depends on the microscopic configura- 
tion c(t) at time t > t' is given by the MFDT: 



R(t,t') = - 



dct>(c(t'),X) 



dt' 



dX 



A(c(t),X ) 



(2) 



A = An 



where (..) denotes the average in the stationary state with 
the control parameter Ao- The relation @ has been de- 
rived in the recent Ref. [24] for the particular observable 
A(c, A) = d(f>(c,X)/dX, and before that in Ref. [T5] (re- 
lation 7.15) for the particular case of diffusion processes. 
We also note that in Eq. @, the function (j)(c, X) plays 
the role of the energy. For thermal equilibrium, we have 
cj)(c, A) = f3{H{c) - AO(c) - P(A)), where F(X) is the free 
energy and Eq. ([1} is retrieved [using the abbreviation 
0(f) = 0(c(t'))}. 

Modified fluctuation-dissipation theorems have ap- 
peared in various forms in the recent literature [3J[T5, 19, 
[22] . In the first section of this paper, we present an el- 
ementary and self-contained derivation of such a result, 
which holds for any single-time observable A(t) and for 
systems close to non-equilibrium steady-states and obey- 
ing markovian dynamics. In the second section, we discuss 
the interpretation of this relation in terms of trajectory 
entropy excess, and finally we apply this framework to a 
simple model of molecular motor. 

Derivation of a modified fluctuation-dissipation 
theorem. — We consider a system which evolves accord- 
ing to a continuous time Markovian dynamics. The tran- 
sition rate from a configuration c to a configuration c' is 
denoted by W\(c',c) to emphasize its dependence on the 
control parameter X(t) which can vary with time. For each 
path trajectory, we introduce, as in |13) . the functional 
Y(t) given by 



(3) 



Y(t) plays a role similar to the work in the Jarzynski re- 
lation [25] . The joint probability 



P t (c, Y) = (6(c - c(t))S(Y - Y(i))) path 



(4) 



for the system to be in configuration c at time t with 
Y(t) = Y evolves according to 

°*&n = £ W x (c,c')P t (c>,Y) - X d ^ A > 



dX 



dY 



(5) 



The Laplace transform of P t (c, Y), given by P t (c, 7) = 
/ dY P t {c 1 Y)e~ lY , obeys the modified master equation: 



SP 
dt 



Y J Wl(c,c')P t {c')=Wl-P u (6) 



where W? is the matrix of elements 



WZ(c,c') = W x (c,c')-X^6 c 



(7) 



For a fixed value of A there exists a stationary state P s t 
such that W\ ■ P s t = 0. Then, it can be checked directly 
that the "accompanying" distribution (first defined in 
Ref. g]) P st (c, X(t)) = e -^ c ' X W\ solves Eq. © for 7 = 1. 
Note that this "accompanying" distribution P st (c,X(t)) 
is not stationary because it acquires a time dependence 
through X(t). Therefore, we have P t (c, 1) = e -^ c > A W), or 
cquivalently 



<<5( C - C (t))e- y «) pa th = e 



-0(c,A(t)) 



(8) 



We emphasize that the l.h.s. depends on the full path 
history between time and t, because c(t) and Y(t) do 
so, whereas the r.h.s. is a function only of the steady 
state probability corresponding to the value of A at the 
final time t. This relation involves weighted averages with 
respect to the functional e~ Y ^ and relates non-stationary 
expectation values to behavior in the stationary state. The 
use of appropriately weighted distribution functions lies 
at the core of the various noncquilibrium identities, as 
emphasized in the very first works of C. Jarzynski i7 s 25 
(see also [H[2H1[27]). The relation © will also play a 
key role in deriving the modified FDT. Multiplying this 
equation by an arbitrary observable A(c, X) and summing 
over all microscopic configurations c, we obtain a detailed 
version of the Hatano-Sasa identity [T3] 



(A(c(t),X(t))e- Y ^) piith = (A(X(t))) Ne 



(9) 



where (..)Ness denotes the average in the stationary state 
at time t with control parameter X(t). We now take the 
functional derivative of this relation with respect to A(t') 
with t' < t by considering a small variation in the vicinity 
of the stationary state X(t') = A + 5X(t') with SX(t') < 1 
and 8X(t') <C 1. Then, Y(t) being small, we can write at 
first order e~ Y ^ ~ 1 — Y(t). Taking into account that 
the functional derivative of the r.h.s. of Equation ^ with 
respect to A(t') vanishes for t' < t, we obtain 



<J<A(c(t),A(i))) pa th _ S(Y(t)A(c(t),X(t))) p&th 



5X(t>) 



5X(t>) 



(10) 



The functional derivative of the r.h.s. in the vicinity of 
Ao contains only one term instead of two because Y(t) 
vanishes when X(t') takes the constant value Aq. Using 



SY(t) 
6X(f) 



d d<Kc(t),\o) 



Ao 



dt' 



dX 



(11) 
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we obtain 

-R(M ) = A(c(t),A ))A(t)=Ao ■ ( 12 ) 

In the expectation value the control parameter is now fixed 
at A and Eq. @ is proved. Introducing the observable 
0(c) = —d\P s t{c)/P st (c), Eq. © can be rewritten as 



d 



R(t,t') = -—(A(t)0(t')) . 



(13) 



Remark: More general versions of the FDT, valid for an 
arbitrary observable F[c, A], that depends on the whole 
path (and not on the final configuration only) can be de- 
rived [15j by comparing the weights of direct and reverse 
path trajectories and using a local detailed balance con- 
dition, in the spirit of [TTJ. The fundamental relation © 
has to be replaced by 



(F[c,\]e- nt) ) pa tH = (F[c,X])l 



path' 



(14) 



where the tilde and the index r denotes an average with 
respect to reverse paths. We emphasize, however, that in 
the derivation given above of the relation ([2]) no symmetry 
property under time-reversal has been used. 

Connection between MFDT and entropy pro- 
duction. — An important step towards an unification of 
the various formulations of FDT for non-equilibrium sys- 
tems comes from the realization that the MFDT can be 
given by a thermodynamic interpretation in terms of tra- 
jectory entropy excess . Recently, a new decom- 
position of the entropy production has been introduced in 
Refs. [TT1I2H] m a particularly clear way. This motivated 
us to revisit the derivation of the MFDT of Refs. [131125] 
with this formalism. As expected, the decomposition of 
the entropy production leads to an MFDT which is the 
sum of an equilibrium part and an additive correction. 

We now focus on individual stochastic trajectories taken 
by the system. Between the time t = and t = T, these 
trajectories can be represented by the set of discrete val- 
ues C = {cq,ci....cn} and jumping times t 2 ;. The system 
stochastic entropy is defined as s(t) = — hiP t (c(i)), as a 
trajectory dependent quantity with c{t) taking values in 
C [5] . Following [35] , we define the rate of change of the 
excess entropy 



s ex (t) = f> - 7-,) In p^'Vv ( 15 ) 



where Ti represents the time where the system jumps from 
state Ci-i to state Cj. It follows that the integral of s ex {t') 
from t' = to t, As ex (t) corresponds to the excess heat 
defined in [TJ], which satisfies As ex (t) = Y(t) — A(f>(t) 
where A^t) = <j>(c(t) , A(f)) - </>(c(0), A(0)). 



On a trajectory where A is fixed at Ao, 

N 



ds ex {t) 



dX 



A=A 



d , P st (ci, A ) 



d\ P st {ci-i, x a y 

n 

d dc/)(c(t),X ) 



dt 



dX 



(16) 



After moving the time derivative in the r.h.s. of Eq. [5] into 
the correlation function, we can then use Eq. [R)] to obtain 
another formulation of MFDT: 



(17) 



As shown in Refs. [TTJ [2H], the excess entropy can be 
decomposed as s ex = s r — s a , where s r is the reservoir 
entropy and s a the adiabatic entropy (also called house- 
keeping heat [13] )■ These quantities satisfy: 



N 



W\ T . (c^Ci-i) 



s r (t) = ^^-rOln- 

N 

r-f Wx T .{ci-i,Ci)P s t{ci,X Ti ) 



W\ T . (ci_i,Cj) ' 

W\ T . (ci, Ci—i)P s t (cj_ Xj X Ti ) 



In the stationary state (NESS) at A = Ao, it follows from 
Eq. [15] that s ex = — s, and thus Ea.fTTl agrees with Eq. 17 
of Ref. [TS]. This also implies s na = 0, and s a = s tot , and 
since s r = s me d, the splitting of the entropy excess which 
is used here is the same as that of Ref. [T!5] . 

We now proceed in deriving another form of MFDT with 
this framework. We assume that the system satisfies a 
generalized detailed balance condition 



W x (c,c') = W Xo (c,c') 
Wx(J,c) W Xo (c',c) 



cxp (6Xd(c, c')) 



(18) 



where d(c, c') describes the variation of a dimcnsionless 
physical quantity during a transition from state d to state 
c such that d{c, d) = —d(c',c) [28] . Using Eq. [TBI and the 
definition of s r one obtains 



A" 



9\S r (t') = J2 5 W - TtW*,*-!) = j(t'), 



(19) 



where j(t') corresponds to a physical current. Similarly, 
one can define v{t') = d\s a (t'), in such a way that the 
response function takes the form 



R(t-t') = (A(t)(j(t')-u(t'))), 



(20) 



This form is analogous to the one first obtained for a par- 
ticle obeying Langevin dynamics |18j , which has the prop- 
erty that an equilibrium form of FDT can be restored in 
a locally moving frame |15j . However, it is important to 
realize that the v introduced above is different from the 
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mean local velocity used in these references, although both 
quantities lead to the same correlation function |19) . 

For practical applications of this result, more explicit 
expressions of the currents j(t') and v(t') are needed. For 
the part of the response function coming from the reservoir 
entropy (the equilibrium part), we can write 

N 

(A(t)j(t')) = (A(t) 5(t' - n)d( Ci , ci_i)), 

= A n P{n, t\c, t' + )P(c, t'+\c', t'-)P st (c', A )d(c, c'), 

c,c' ,n 

which corresponds to a sum over trajectories which jump 
at time t'. We have denoted P(n,t\c,t' + ) the conditional 
probability to be in state n at time t provided that the 
state c was visited immediately after the jump at time 
t l+ . This quantity needs to be evaluated at A(i') = Ao- 
Then, it follows that (A(t)j(t')) is equal to 

y2A n (6 c ^ n 5 c ^) c ) ^ X ° C ' \ p st (c' ,\ )d{c,c') 

c,c',n ( 21 ) 

= (A(t)J2^c(t>)cj{c,Xo)), 

c 

where j(c, Ao) are components of the current j(t f ) defined 
by 

j(c, Ao) = £ #H^o (c, c')d(c, c'). (22) 

'—f ^st(C, A J 

A similar calculation can be carried out for the part 
of the response function associated with the adiabatic en- 
tropy: 

(A(t)u(t')) = (A(t) S c(n Mc, Ao)), (23) 

C 

where the components of the local current v{t') are given 
by 

"(c Ao) = E pf^l fr ln ( c '' c )' ( 24 ) 
^ P st {c, A ) 

and J s t (c' , c) denotes the probability current 
P st (c,X )W Xo {c',c) - P st {c',\ )W Xo {c,c'). Note that 
Eq. [2U agrees with the results given in Ref. [55] . 

A discrete ratchet model. — We now apply the 
framework developed above to a discrete ratchet model 
of a molecular motor. Single molecular motors have been 
traditionally modeled either by continuous models such 
as the flashing ratchet model [3D] or by discrete models 
based on the master equation formalism |31j . In previous 
works, we have shown that the Gallavotti-Cohen symme- 
try is present both in discrete models [32][33] and in con- 
tinuous ones |34| when all the relevant variables are taken 
into account. 

In the discrete ratchet model, a single motor evolves 
on a linear discrete lattice by hopping from one site to 
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Fig. 1: A schematic representation of the motor on a linear 
lattice of sites a (even) and b (odd). All possible transitions 
are displayed with their corresponding rates. 

neighboring sites, either consuming or producing ATP 
molecules as shown in figure ([1} . The position of the mo- 
tor is denoted by x = ndo, where 2do is the step size of 
the motor, and y denotes the number of ATP molecules 
consumed. Because of the periodicity of the filament, all 
the even (a) sites and all the odd (b) sites are equivalent. 
Denoted by tu a (and at Q ) are the transition rates for the 
motor to jump from site a to the neighboring site b to the 
left (to the right), respectively. A similar definition holds 
for the site 6 and we use the abbreviations u>i = tJi + oJj 
for i = a,b, and fi = u a + loi,. 

The probability to find the motor in a given state, say 
i = a, b is Pi{t) = (<5ic(t))path, where c{t) is the configura- 
tion of the system at time t in the space of configuration 
a, b. Similarly, the joint probability to be in state i at time 
t&nd in state j at time t' is P(i,t; j,t') = (6 ic ^jc(t')) path- 
Both quantities can be calculated analytically for this 
model even for time dependent rates. We now assume 
that the rates depend on time only via an arbitrary con- 
trolled parameter X(t), and we note that this dependence 
can be non-linear. As a result, the time dependance of an 
arbitrary observable A(c(t), A) has the form 

A(c(t),A) = A a (X)S ac{t) +A b (X)S bc{t) . (25) 

In particular, the function </>(c(£),A) has this form with 
Q (A) = -logP st (a,A) = -log[a; 6 (A)/Q(A)] and </> b (X) = 
-logP st (&, A) = -Iog[w„(A)/n(A)]. 

With the above equations, we can characterize the re- 
sponse of the system to a perturbation of the rates of the 
form uji(X(t)) = uji(Xo) + 5X(t)d\LUi(Xo) for i = a 7 b. We 
have separately calculated both sides of Eq. ([2]), and we 
found in agreement with this equation the same quantity, 
which is the response function associated with the observ- 
able A(c, A): 

mt) = 0(Aol 

[A a (X ) - A b (X )] cxp [-fi(A )(i - t% (26) 

for t > t'. 

Decomposition of the response function. We now pro- 
ceed in decomposing the above response function as a sum 
of two terms, which correspond to the two parts of the en- 
tropy production discussed in the previous section. In the 
following, we chose for the control parameter either the 
normalized force applied on the motor, /, or the normal- 
ized chemical potential difference associated with the ATP 
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hydrolysis reaction, A/i. These quantities are defined as 
/ = Fd^/hsT and A/i = A/i/fe^T, in terms of the ap- 
plied force F, and the chemical potential difference A/L 
The sign convention for the force is such that it is positive 
when it is in the motor motion direction. 

In the case of a pure mechanical perturbation, X(t) = 
f(t) = fo + 5f(t). The generalized detailed balance rela- 
tions of Eq. [TH] now takes the following form: 



= «j(o) f 5Ji(f) = Si(o) _ f 



(27) 



with the correspondance d(n ± l,n) = ±1, valid for any 
position n. These relations are obeyed by the following 
parametrization of the rates 



K(f) = u'e-^'f 



(28) 



where + and 0~ are load distribution factors [3"T] . 

The motor velocity can be defined generally by (v(t)) = 
J2 n ndP n (t)/dt, with P n (t) the probability to find the mo- 
tor on an integer position n at time t. Since this velocity 
is the current of the position variable, Eq. [22] can be used 
to define the components of this current: 

v(a, f ) = d J 5 * P [wt(fo) - &i(fo)] , 
^st{a, Jo) 

and similarly for v(b, fo) by exchanging a and b. In a 
similar way, the components of the local current can be 
obtained from Eq. [M] 

/ f , (Q + + o-)v fh (2-e+-e-)v 



2Pst(a,f ) 



2P st (6,/o) ' 



with v = (v(t)) = (v(t)). Now, as in Eq. ([2"0"]l . we obtain 
the response function associated with an observable A : 



S(A(t)) path 



■(A(t)(v(t')-v(t'))). (29) 



For the case of a chemical perturbation in the concen- 
trations of ATP, or of ADP and P, the control parameter 
is X(t) = Afi(t) = Afio + SAfi(t). The transition rates for 
the motor to jump from a site i to a neighboring site on 
the left or on the right with l(= —1,0, 1) ATP molecules 
consumed are io\ =u^ l +tJi l , with i — a,b. Local detailed 



balance conditions similar to Eq. (|27|) imply the following 
parametrization of the rates 



(a + a')e 
(u)' + u)er\ 



wr 1 = (a + a')e (<T - 1)AAI , 



ui b = to + oj', 



(30) 



where a plays the same role as the 9 + and 9~ before. 
Then, by a similar calculation, the response function can 
be written as : 



(31) 



where r(i') is the instantaneous ATP consumption rate 
and TZ(t') the local ATP consumption rate, defined by 
their components 

r(a,A/i ) = -oJ b 1 (Afj,o)Pst(b,Afj,o)/Pst(a,Afj, ), 

r(b,Afi Q ) = ^(A/xo)P s t(a,A/x )/P S i(6,AMo), 

7£(a,A/x ) = af/P st (a,Afi ), 

Uib, Alio) = (l-a)f/P st (b,Afi ). 

Now, we can also introduce more general rates, which 
depend on both control parameters / and A/j, [32]. The 
method presented above in the particular cases where only 
a mechanical degree of freedom or only a chemical de- 
gree of freedom is taken into account, can be extended to 
more general situations where the state of motor is de- 
scribed by both variables. In this case, the same function 
cj)(c, A) can be used, with the understanding that c con- 
tains some dummy variables (the position variable x(t) 
or the chemical variable y(t)) in addition to the variables 
used to describe the non-equilibrium steady state (namely 
i = a,b). By proceeding just as above, one obtains the 
response functions in Eq. (|32[) . which take the form of 
modified Grecn-Kubo relations |2"51I3"51 



(f(£))path 



(v) 



dt'SAf,(t')(v(t)(r(t')-n(t'))), 



:*)> P ath <r> = fdt' 5 jP-(r(t)(v(t') v(t'))) 







d 



dt' SAfx(t')(r{t){r{t') - K{t'))). (32) 



A few remarks about these equations are in order: First, 
in the particular case of an equilibrium steady-state (when 
v = 72. = 0), the Einstein and Onsager relations are 
clearly recovered from these equations. Secondly, near a 
non-equilibrium steady state, these equations characterize 
the response of the motor in the linear response regime, 
thus extending the results of Ref. [32] to the case of time- 
dependent perturbations. As expected from the linearity 
of the problem, the response can be decomposed as the 
sum of contributions corresponding to the cases of pure 
mechanical and pure chemical perturbations. 

Furthermore, we note that the Einstein relation for the 
mechanical variable is recovered only near stalling, just as 
in the case of time independent perturbations |33j . How- 
ever, as pointed out in Ref. [28j . in more general networks 
of chemical reactions, there are additional conditions be- 
sides the stalling condition for the Einstein relation to 
hold. In this model a mechanical perturbation applied 
to the motor at stalling is thus unable to detect that the 
system is in a NESS. But, if a perturbation in the more rel- 
evant chemical variable is considered, then the NESS can 
be detected. This point is illustrated in figure ©, which 
shows the deviation from the standard FDT (at equilib- 
rium), deviation which can be predicted from Eq. Q32[). 
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Fig. 2: Response function of the motor velocity R(t, 0), as func- 
tion of time t for a perturbation of the chemical potential A/j, 
applied at time (solid line), correlation function of the ve- 
locity with the ATP consumption rate, (v(i)r(0)) (line-dotted 
curve), and correlation function of the velocity with the local 
ATP consumption rate {v(t)lZ(0)) (dashed line). The initial 
condition corresponds to stalling for which v = 0. For these 
curves, we have used the following parameters: e = 10.81, 
do = 4nm, uj = 3.5s" 1 , u' = 108.15s" 1 , a = 0.57s -1 , 
a' = 1.3 x 10- 6 s-\ 6+ = 0.705, 6~ = 1.375, a = 0.8, 
A/it = 11.8 and / = —3.82 (stalling force). The sum of the 
two dashed lines gives the solid curve as imposed by Eq. ([32]). 

Conclusion. — We have presented a general self- 
contained derivation of the modified FDT for systems close 
to non-equilibrium steady-states and obeying markovian 
dynamics. We believe that this derivation, which is re- 
lated to many recent works on fluctuation relations, is 
sufficiently general to lead to further developments. We 
have also shown that the MFDT can be expressed as the 
correlation function of a general observable with the tra- 
jectory entropy excess, which leads to the decomposition 
of the MFDT into two terms. 

We have applied this framework to a simple model of 
molecular motor for which the steady-state probability 
distribution is known analytically. Finally, we have ob- 
served that the modified FDT relation requires a knowl- 
edge of the relevant degrees of freedom in order to be able 
to distinguish an equilibrium state from a non-equilibrium 
steady state. In this choice of the relevant degrees of free- 
dom, the markovianity of the dynamics plays a central 
role, as it does for the existence of a Gallavotti- Cohen 
symmetry. 
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